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A  structured  light  or  active  illumination  visual  sensor  is  one 
which  illuminates  objects  using  non-uniform  beams  of  light  on  which 
properties  varying  from  point  to  point  through  the  geometric  extent  of 
the  beam  have  been  impressed.  Any  observable  property  can  be  used  to 
form  such  a  beam;  among  properties  which  one  might  think  of  exploiting 
are  intensity,  polarisation,  spectral  distribution  of  optical  energy, 
coherence,  and  (temporal)  modulation.  Structured  light  sensors  can  be 
used  to  achieve  3-D  vision,  that  is,  to  build  visual  sensors  that 
report  the  true  position  in  3-dimensional  space  of  points  on  the 
surface  of  a  body  or  bodies  being  observed.  Besides  giving  information 
on  object  proximity,  sensor  output  of  this  kind  should  be  very  useful 
for  identifying  the  objects  present  in  a  scene  and  determining  their 
positions  and  orientations. 

The  simplest  form  of  structured  li(»ht  approach  is  the  striped 
light  scheme  originally  introduced  by  P.  Will  and  K.  Pennington  of  IBM 
Research.  In  this  sensor  (see  Fig.  1)  a  plane  P  of  light  formed  by 
passing  colliraated  light  from  a  source  S  through  a  slit  is  used  to 
illuminate  a  body  B.  The  resulting  illuminated  stripe  on  the  body  B  is 
observed  through  a  camera  C  offset  from  the  source  S.  Then  the  3-D 
position  of  each  illuminated  point  X  can  be  calculated  as  the  unique 
point  of  intersection  of  the  plane  P  with  the  known  line  L  from  the 
camera  through  X.  Note  that  L  is  known  since  it  is  determined 
geometrically  by  the  point  at  which  the  image  of  X  falls  on  the  retina 
of  C.  (See  Fig.  1,  below„ )  We  also  suppose  this  wedge  of  light  to  be 
structured,  in  the  sense  that  some  measurable  property  Q  is  imposed 
upon  its  separate  rays;  this  property  is  assumed  to  be  constant  in  each 
vertical  plane  of  the  wedge  W,  but  to  vary  monotonically  from  left  to 
right  across  the  wedge,  which  is  to  say  monotonically  with  the 
geometric  parameter  h  shown  in  Fig.  2,  which  defines  the  vertical 
plane  in  which  a  given  point  of  W  lies. 

In  the  Will-Pennington  scheme,  the  whole  surface  of  the  body  B  can 
be  determined  by  panning  the  plane  P  over  the  whole  visual  field.  An 
improved  scheme,  which  allows  this  whole  surface  to  be  determined  more 
rapidly,  is  as  follows.  Suppose  that  the  body  3  is  illuminated  by  a 
wedge  W  of  light  as  in  Fig.   2  below. 

The  internal  property  Q  imposed  upon  the  wedge  W  of  light  must 
have  the  following  properties: 

(i)   There  must  exist  some  convenient  way  of  imposing  the  property  Q  on 
the  wedge  v;  of  light,  and  of  causing  Q  to  vary  in  the  desired  manner. 
(ii)  Q  must  be  detectable  by  the  camera  being  used. 
(iii)  Q  must  be  invariant  under  reflection. 
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Fig.  1.   The  basic  Will-Pennington  striped  light  scheme. 
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Fig.  2.   Illunination  of  a  body  by  a  structured  wedge  of  light. 
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Property  (iii)  is  required  since  light  projected  on  a  point  P  on 
the  body  B  will  only  be  observed  after  reflection  from  B,  so  that  a 
property  Q  that  was  modified  by  reflection  might  be  distorted  in  some 
unpredictable  manner.  Thus  Q  cannot  simply  be  light  intensity,  average 
color,  or  polarisation,  since  reflection  from  a  body  of  varying  or 
unknown  color,  albedo,  or  polarising  properties  could  modify  any  single 
one  of  these  properties. 

For  this  reason,  the  simplest  property  that  can  be  used  for  Q  is 
the  ratio  12/11  of  two  intensities.  More  specifically,  we  can  proceed 
as  follows.  Form  two  successive  images  of  the  body  B,  the  first  under 
uniform  illumination  11(h)  =  const.,  the  second  under  an  illumination 
12(h)  that  varies  linearly  as  the  geometric  parameter  h  varies  from 
left  to  right  over  the  wedge  W  of  light.  Then  form  the  ratio  Q(h)  of 
the  two  reflected  intensities.  Assuming  that  the  body  B  is  in  perfect 
focus,  the  ratio  of  reflected  Intensities  must  be  equal  to  the  ratio 
I2(h)/Il(h)  of  incident  intensities.  To  see  this,  simply  note  that 
reflected  intensity  can  be  regarded  as  the  number  of  photons  per  second 
reflected  from  a  given  point  on  the  surface  of  Bl  and  since  photons  are 
reflected  individually  the  number  of  photons  reflected  from  a  point  is 
proportional  to  the  number  projected  as  the  point  p  in  an  incident 
beam. 

Therefore  let  the  symbol  R(h)  denote  the  ratio  12(h)/Il(h).  Then 
R(h)  is  invariant  in  the  sense  explained  above,  and  the  value  of  R(h) 
determines  h  uniquely.  Hence  by  measuring  R(h)  and  triangulating  in 
the  manner  already  explained  we  can  hope  to  determine  the  true 
three-dimensional  locations  of  all  points  visible  on  the  surface  of  the 
body.  Of  course,  empirical  difficulties  ignored  in  our  oversimplified 
account  complicate  the  situation.  Among  other  problems,  a  successful 
version  of  the  sensor  described  will  have  to  compensate  for 

(i)   nonlinearitles  In  the  reaction  to  incident  light  .of  the  electronic 

camera  used; 

(li)  smearing  effects  caused  by  lack  of  focus; 

(iii)  ambient  light  effects. 

Nevertheless  we  expect  the  performance  of  this  sensor  to  far  outstrip 
that  of  uniform-illumination  sensors  which  must  rely  on  complex 
binocular-matching  or  shape-f rom-shading  procedures  to  reconstruct  3-D 
information.  Note  also  that  If  the  camera  used  is  not  capable  of 
recognising  a  sufficient  range  of  grey-levels  to  support  accurate 
triangulatlon,  accuracy  can  be  Improved  by  projecting  narrower  but 
similarly  structured  beams  on  succeslve  halves,  or  even  smaller 
portions,  of  a  scene,  and  using  the  binary  sequence  of  position  codes 
that  can  be  developed  in  this  way  to  improve  accuracy.  Images  acquired 
from  several  camera  positons,  or  using  beams  in  which  intensity  varies 
in  directions  other  than  the  horizontal,  or  images  acquired  after 
deliberate  variation  of  focal  plane  position  are  all  potentially  useful 
for  improving  the  accuracy  of  this  device. 


Note  that  the  device  that  has  been  described  can  be  realised 
without  any  moving  parts,  either  by  switching  light  sources  on  and  off 
or   by   using   optically   active   materials   to   rotate   the   plane   of 


polarisation  of  a  collimated  and  polarised  light  beam  on  which 
intensity  gradients  are  imposed  by  reflection  at  or  near  the  Brewster 
angle. 

Experimental  work  on  this  sensor  is  being  undertaken  by  Mr.  Brian 
Carrihill  of  the  N.Y.U.  Robotics  laboratory,  and  we  hope  to  be  able 
soon  to  report  on  its  measured  performance. 
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